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Abstract 


Consider  a multi-machine  scheduling  problem  in  which  the  jobs  (of  unit 
duration)  may  have  non-zero  release  times,  monotonic  increasing  deferral  costs, 
and  general  precedence  relationships  between  them.  In  general,  efficient  op- 
timal solution  techniques  do  not  exist  for  problems  of  this  type,  and,  typi- 
cally, realistically  sized  problems  must  be  solved  using  heuristics.  We 
present  an  efficient  method  for  implementing  job  interchange  techniques  for 
improving  heuristically  derived  schedules. 

The  method  is  tested  on  over  200  randomly  generated  (NP-complete)  prob- 
lems. 98.5%  of  the  problems  are  solved  optimally.  Finally,  it  is  noted  that 
the  quality  of  the  solution  technique  does  not  appear  to  be  limited  by  com- 
putation costs,  but  rather  by  the  (one  time)  developmental  cost  of  the  inter- 
change computer  code. 
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Introduction 


Consider  a multi-machine  (parallel  processor)  scheduling  problem  in 
which  the  jobs  have  monotonic  increasing  deferral  costs,  may  be  partially 
ordered  by  a set  of  general  precedence  constraints,  and  may  have  non-zero 
release  times.  The  scheduling  objective  is  a function  of  the  job  deferral 
costs.  It  is  assumed  that  jobs  are  scheduled  for  discrete  periods  (i.e., 
all  jobs  have  unit  processing  time)  and  that  the  setup  time  either  takes 
place  between  periods  or  is  included  in  the  processing  time. 

This  is  a reasonably  general  problem  description  and  includes  several 
problems  that  have  been  shown  to  be  NP-complete  [8].  For  many  problems  of 
this  type,  the  best  available  solution  procedure  may  be  a heuristic.  Often 
there  is  room  for  improvement  in  the  solutions  found  by  these  methods.  The 
purpose  of  this  note  is  to  present  a methodology  for  improving  heuristic  solu- 
tions to  these  scheduling  problems.  The  methodology  used  is  simply  that  of 
interchanging  jobs  in  the  heuristically  derived  schedule  to  see  if  a better 
schedule  can  be  found.  In  theory,  this  could  result  in  the  evaluation  of  all 
possible  combinations  of  jobs  in  the  schedule.  However,  it  is  not  necessary, 
typically,  to  evaluate  all  possible  combinations  to  find  the  optimal  schedule 
(or  a nearly  optimal  schedule),  and,  if  one  is  clever,  the  computational  effort 
can  be  minimized. 

In  succeeding  sections,  we  first  define  a multiple  interchange  method- 
ology which  can  be  used  to  search  for  improved  schedules.  We  show  how 
the  computational  effort  for  the  higher  order  interchanges  (involving  several 
jobs)  can  be  reduced,  and  develop  a general  structure  for  an  open  ended  inter- 
change procedure.  The  procedure  is  then  tested  on  over  200  randomly  generated 
problems.  For  the  randomly  generated  problem  two  results  are  apparent:  first, 
the  procedure  is  very  effective  (98.5%  of  the  problems  were  solved  optimally); 
and  second,  computational  effort  does  not  appear  to  be  the  limiting  factor  to 
the  approach . 
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Multiple  Interchanges 


After  creating  a schedule  with  a heuristic,  it  can  be  beneficial  to  try  to 
improve  the  solution  by  interchanging  two  or  more  jobs.  What  follows  is  a de- 
scription of  the  forms  which  interchanges  may  take.  It  is  seen  that 
some  of  the  forms  of  three  and  four-way  interchanges  may  be  decomposed 
into  lower  order  interchanges  each  of  which  Improve  the  objective  function.  The 
mechanics  of  the  decomposition  of  three-way  interchanges  receive  closer  examination. 

A two-way  interchange  of  jobs  1 and  2 in  a schedule  would  replace  job  1 on 
its  machine  with  job  2 and  place  job  1 on  the  machine  formerly  occupied  by  job  2. 

An  example  of  a two-way  interchange  is  presented  in  Figure  IB  in  which  jobs  1 and 
2 are  interchanged. 

The  standard  three-way  interchange  is  demonstrated  in  Figure  1A.  Job  1 re- 
places job  3 in  period  t3.  Job  3 replaces  job  2 in  period  t2  which,  in  turn, 
replaces  job  1 in  period  tl.  The  only  other  three-way  interchange  (a  mirror  image) 
occurs  when  job  1 replaces  job  2 in  period  1 2 ; job  2 replaces  job  3 in  period  1 3 ; 
and  job  3 replaces  job  1 in  period  tl. 

The  standard  three-way  interchange  can  be  divided  into  four  cases  each  of  which 
improve  the  solution.  Of  those  four  cases,  three  can  be  decomposed  into  two  two-way 
interchanges  which  improve  the  solution  at  each  interchange.  Thus,  only  one  case 
requires  an  actual  three-way  interchange  be  performed  to  accomplish  its  goals. 

(As  will  be  seen  later,  this  can  result  in  considerable  computational  savings.) 

Case  1 involves  either  a precedence  constraint  between  jobs  2 and  3 or  a higher 
deferral  cost  for  job  2 than  job  3.  In  this  case  both  jobs  2 and  3 have  higher 
costs  than  job  1.  Therefore,  the  interchange  can  be  decomposed  into  the  two-way 
interchange  of  Figure  IB,  followed  by  that  of  Figure  1C.  Both  two-way  interchanges 
improve  the  solution. 

Case  2 involves  no  precedence  constraint  between  jobs  2 and  3 and  a higher  de- 
ferral cost  for  job  3 than  job  2.  Since  job  3 also  has  a higher  cost  than  job  I,  (lie 
two-way  interchange  of  Figure  ID  would  be  more  advantageous  and  would  save  the 
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Figure  1A.  Standard  3-way  interchange 
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Figure  IB.  Standard  3-way  interchange-first  step 
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inevitable  interchange  of  jobs  2 and  3. 
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Case  3 involves  a deferral  cost  for  job  3 no  greater  than  that  of  job  1.  In 
this  case,  the  two-way  interchange  of  Figure  IB  accomplishes  the  improvement 
and  saves  a possible  interchange  of  jobs  1 and  3. 

Case  4 is  the  genuine  non-decompe.  able  three-way  interchange  of  Figure  1A. 

It  requires  a precedence  constraint  between  jobs  2 and  3 and  a deferral  cost  no 
higher  for  job  2 than  for  job  1,  or  it  requires  a deferral  cost  no  higher  for 
jobs  2 and  3 than  for  job  1 with  the  sum  of  deferral  costs  for  jobs  2 and  3 
greater  than  for  job  1.  It  is  this  case  and  its  mirror  image  which  the  three- 

way  interchange  routine  is  programmed  to  detect. 

Where  the  three-way  interchange  has  two  standard  forms  (including  a mirror 

image),  the  four-way  interchange  has  five  standard  forms  (including  a mirror 
image).  Two  of  the  forms,  and  part  of  a third,  can  be  shown  to  decompose  into 
sets  of  two-way  interchanges  which  improve  the  solution  at  each  interchange,  or 
a combination  of  two  and  three-way  interchanges  which  improve  the  solution  at 
each  interchange.  Clearly,  this  analysis  could  be  extended  to  higher  levels  of 
interchange  if  one  was  willing  to  evaluate  the  increasingly  complex  combinatoric 
structure . 

The  result  of  all  of  this  is  that  when  programming  the  search  for  three,  four, 
or  k-way  interchanges  that  will  improve  the  solution,  many  combinations  can  be 
explicitly  eliminated  from  consideration.  This  will  reduce  the  computational  re- 
quirements to  less  than  complete  enumeration.  The  question  is:  How  much? 
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It  appears  from  the  discussion  of  the  previous  section  that  there  may  be  a 
savings  in  computation  time  to  be  realized  from  decomposing  multiple  interchanges 
into  lower  order  interchanges.  A logical  way  to  implement  this  approach  when  the 
interchange  procedures  have  been  developed  up  to  some  level  k is  as  follows: 

Step  1.  Set  i = 2 and  make  all  nondecomposable  i-way  interchanges  of 
jobs  which  improve  the  solution. 

Step  2.  If  i < k,  set  i = i+1.  Otherwise,  stop. 

Step  3.  If  a nondecomposable  i-way  interchange  which  would  improve  the 
solution  exists,  make  it  and  go  to  Step  1.  Otherwise,  to  to 
Step  2. 

By  the  time  the  interchange  method  has  been  completed,  there  are  no  two- 
way  through  k-way  interchange  improvements  that  can  be  made  in  the  solution. 
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A Test  Problem  for  Experimentation 


In  order  to  test  the  multiple  interchange  method,  an  experimental  problem 
was  chosen.  The  experimental  problem  is  a parallel  processor  problem  with  serial 
precedences  placed  on  groups  of  jobs.  Each  job  i has  an  availability  time 
and  a linear  deferral  cost  c^  which  differs  from  job  to  job.  Lenstra  [8]  showed 
that  the  problem  is  NP-complete.  Elmaghraby  and  Sarin  [3]  developed  bounds  on  a 
heuristic  for  a relaxed  version  of  the  problem.  Loveland  [9]  also  dealt  with 
the  problem. 

Other  papers  deal  with  further  relaxations  of  the  problem  in  which  each  job 
lias  the  same  availability  time  and  there  is  a single  machine.  Horn  [6]  considers 
the  case  in  which  the  precedences  are  sets  of  arborescences  (forests).  Adolphson 
and  Hu  [1]  solve  Horn's  problem  for  a single  arborescence  in  worst  case  time 
0(n  log  n)  and  shorten  Horn’s  proof.  Lawler  [7]  solves  a problem  in  which  the 
precedences  involve  parallel  series  of  jobs  and  realizes  a worst  case  time  of 
0(n  log  n).  Sidney  [10]  develops  an  algorithm  which  decomposes  and  solves  gen- 
eral, acyclic  networks  of  jobs. 

Hodgson  and  Loveland  [4,  5]  address  a multi-machine  problem  which  has  similar 
structure  but  minimizes  the  completion  time  of  the  latest  job.  Martin-Vega,  and 
Ratliff  [2]  survey  parallel  processor  scheduling  problems. 
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The  Heuristics 


In  order  to  have  an  initial  feasible  solution  as  a starting  point  for  test- 
ing the  multiple  interchange  method,  two  heuristic  techniques  are  used.  The  two 
individual  heuristics  analyze  the  strings  of  jobs  defined  by  the  serial  precedence 
constraints.  A feasible  substring  of  such  a job  string  consists  of  the  first  avail- 
able job  on  that  string  and  the  rest  of  the  consecutive  jobs  from  that  string  which 
are  available  to  the  machines  immediately  succeeding  that  first  available  machine. 
Each  heuristic  uses  a form  of  the  feasible  substring. 

The  first  heuristic,  called  SCHED1,  schedules  one  job  at  a time.  It  is 
based  on  a measure  of  the  potential  penalty  of  not  scheduling  a given  job  on  the 
first  available  machine.  The  calculation  is  made  for  the  first  job,  if  available, 
of  each  job  string.  The  potential  penalty  is  the  sum  of  the  deferral  costs  of 
those  jobs  on  the  feasible  substring  which  would  be  forced  into  a later  period, 
if  the  first  available  job  is  scheduled  on  the  second  available  machine.  The 
job  having  the  greatest  potential  penalty  is  scheduled  on  the  first  available 
machine.  The  analysis  is  then  repeated  for  each  job  string,  until  all  the  jobs 
are  scheduled. 

The  second  heuristic,  called  SCHED2,  is  an  adaptation  of  Sidney's  algorithm 
[10]  for  the  single-machine  problem  in  which  all  jobs  have  the  same  availability 
time.  This  heuristic  schedules  complete  substrings  of  jobs  at  a time.  It  con- 
siders each  substring  of  every  feasible  substring  (i.e.,  the  first  job,  the  first 
and  second  jobs,  etc.).  Since  each  job  has  a unit  processing  time,  the  figure 
of  interest  is  the  ratio  of  the  sum  of  the  deferral  costs  of  the  job  in  the  sub- 
string to  the  number  of  jobs  in  the  substring.  The  substring  having  the  highest 
ratio  is  scheduled.  The  analysis  is  then  repeated  for  all  the  substrings  of  the 
feasible  substrings,  until  all  the  jobs  are  scheduled. 


8 


Testing  and  Results 


To  evaluate  the  efficiency  and  the  potential  contribution  towards  optimality 
in  the  interchange  method,  over  200  test  problems  were  randomly  generated.  Avail- 
ability times  were  randomly  spaced  over  the  first  25  periods.  The  problems  were 
divided  into  two  categories:  in  the  first  each  problem  had  two  machines  and  30 
jobs;  and  the  second  category  had  four  machines  and  50  jobs  per  problem  (the 
number  of  jobs  used  was  limited  by  the  computational  limits  of  an  enumeration  al- 
gorithm which  was  used  to  find  optimal  solutions  to  the  test  problems). 

The  heuristics  were  applied  to  each  test  problem  to  provide  starting  points 
for  the  interchange  method.  Two,  three,  and  four-way  interchanges  were  used  on 
each  solution  in  order  to  determine  the  relative  effectiveness  of  each.  The 
statistics  gathered  were  the  percent  of  problems  solved  optimally,  the  average  per- 
cent error  for  all  problems,  the  maximum  percent  error,  and  the  average  execution 

_2 

time.  (Note  that  the  execution  time  is  in  units  of  10  seconds). 

Table  1 contains  the  results  of  the  two-machine  problems.  Table  2 contains 
the  corresponding  results  of  the  four-machine  problems.  The  interchange  method 
shows  a steady  improvement  in  accuracy  for  the  individual  heuristics  as  the  level 
of  interchanges  used  increases.  Figures  2 and  3 are  based  on  the  combined  data 
from  the  two  and  four-machine  problems.  Both  of  these  figures  appear  to  indi- 
cate that  regardless  of  its  starting  point  the  interchange  method  rapidly  (in 
terms  of  level  of  interchange)  becomes  quite  accurate.  In  addition,  by  taking 
the  best  solution  for  each  problem  the  joint  results  also  show  an  improvement. 

(In  other  words,  using  several  starting  points  for  the  multiple  interchange  pro- 
cedure helps  in  getting  around  local  minima). 

Figure  4 demonstrates  that  the  execution  time  appears  to  be  no  worse  than 
a linear  function  of  the  level  of  interchange.  Figure  5 shows  hat  the  develop- 
mental cost  of  the  interchange  method  (as  measured  by  the  number  of  statements 
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Figure  2.  Graph  of  level  of  multiple  interchange  versus 

percent  of  problems  solved  optimally  for  combined 
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Figure  3.  Graph  of  level  of  multiple  Interchange  veraus  average 
percent  error  for  all  problems  for  combined  data 
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Figure  4.  Graph  of  heuristic  execution  time  versus 
level  of  interchange 
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Figure  5.  Graph  of  FORTRAN  statements  versus  level  of  interchange 


in  the  FORTRAN  code)  appears  to  be  an  increasing  convex  function  of  the  level  of 
interchange.  While  the  form  of  Figure  5 is  certainly  to  be  expected.  Figure  4 
is  not.  The  indication  is  that  the  quality  of  the  solution  may  be  more  depend- 
ent on  developmental  effort  (in  terms  of  coding  increasingly  complex  higher  order 
interchanges)  than  on  computational  costs.  If  so,  this  may  point  the  way  for 
further  work  in  the  development  of  a general  structure  for  interchange  methods, 
and  for  further  work  in  the  development  of  bounds  on  heuristic  solutions  which 
have  undergone  k-way  interchange.  (Note  that  the  FORTRAN  code  can  be  obtained 
from  the  authors). 
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